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(57) Abstract: A media object (70) sensed at one location is delivered at a second remote location, or an applicauon associated with 
the object is made available at the second location. In some embodiments, the delivered object is of a higher quality than the sensed 
object In other embodiments, larger objects requiring higher bandwidth for effective transmission are delivered notwithstanding low 
bandwidth bottlenecks between the first ( 12) and second ( 14) locations. Such advantages are achieved by employing watermark data 
as proxies for media objects and associated applications. In some arrangements, the first and second locations are the same, e.g., a 
photocopier (50) scans a paper document, finds a watermark in a photo on the paper document, obtains from a networked resource 
a pristine version of the photo, and substitutes the pristine photo for the scanned photo in the photocopied output. 
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nir.TTAl. WATERMARKS AS D ATA PROXIES 

Field of the Invention 
The present invention relates to digital watermarks, and more particularly 
5 relates to use of watermarks as proxies for data in various applications. 

Summary of the Invention 
As detailed in the assignee's prior applications, including 60/134,782, 
60/141,538, and 09/343,104 (variously merged and supplemented in laid-open 
10 publications WO 00/70585 and WO 00/70523), digital watermark technology has 

numerous applications beyond its traditional role of simply communicating copyright 
information. One futuristic view foresees that all "content" should be watermarked, 
thereby enabling a great variety of operations and transactions whenever watermarked 
content is processed by digital devices equipped with watermark recognition and 
1 5 reading technology. All physical media objects can thereby be inherently and 

persistently digitally-enabled, permitting greatly simplified access to networks and 
execution of local and remote applications. The continuing growth of the Internet and 
beginnings of trends toward pervasive computing signal an opportunity to radically 
change the relationships between traditional media content and digital processing 
20 environments. 

In this specification, content refers not just to electronic audio, image, and video 
files, but also includes the content aspects of physical objects and media, e.g., artwork, 
patterns, and labels on product packaging, concert tickets, etc. 

In accordance with one aspect of the present invention, the processing of 
25 watermark data as pointer to shared resources is sometimes used in lieu of transmitting 
from point to point the object with which it is associated, thereby gaining efficiencies in 
speed and bandwidth. 

In accordance with another aspect of the invention, watermarks are employed in 

OLE-like applications. 

30 Object linking and embedding ("OLE," sometimes also known as dynamic data 

exchange, or "DDE") is a well-known data processing construct by which a first digital 
object (e.g., a graph) can be embedded within a second digital object (e.g., a word 
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processing document). In some embodiments, the embedding is static. That is, once the 
embedding takes place, subsequent changes to the first digital object (e.g., the graph) 
are not reflected in the second, composite digital object (e.g., the document). In other 
embodiments, the embedding is dynamic (and thus more commonly termed linking 
rather than embedding). In such arrangements, if the graph is changed, the document is 
automatically updated to incorporate the latest version of the graph. 

The technology underlying OLE is sophisticated, but is well understood by 
artisans in the field. Reference may be made to the many patents (e.g., 5,58 1 ,760 and 
5,581,686) and reference books (e.g., Brockschmidt, Inside OLE 2 Microsoft Press, 
Redmond, WA, 1 994) on the subject for further details. 

In accordance with this aspect of the invention, OLE-like principles are 
implemented using watermark data in digital objects in order to effect object linking or 
embedding. 

In one such embodiment, a photocopier scans an original paper document to 
produce image data. This image data is analyzed for the presence of watermark data 
that identifies the graphic(s) on the document. With this watermark identifier, the 
photocopier can query a remote image database for pristine image data corresponding 
to the graphic(s) on the document. This pristine data can be relayed from the remote 
database to the photocopier and substituted into the scanned image data. Output printed 
from the photocopier is thus based, at least in part, on pristine image data, rather than 
on image data that has been subjected to various corruption mechanisms (e.g., 
degradation of the original paper document, artifacts due to scanning, etc.). 

This and other features and advantages of the present invention will be more 
readily apparent from the following detailed description, which proceeds with reference 
to the accompanying drawings. 



Brief Des cription of the Drawing s 
Fig. 1 is a diagram illustrating a network environment in which principles of the 
present invention may be employed. 

30 Fig. 2 is a flow chart illustrating aspects of one embodiment of the present 

invention. 
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Fig. 3 is a flow chart illustrating aspects of another embodiment of the present 
invention. 

Fig. 4 is a flow chart illustrating aspects of yet another embodiment of the 
present invention. 

Fig. 5 shows an apparatus according to still another embodiment of the 



Detailed Description 

10 Referring to Fig. 1, consider an exemplary network 10 linking two devices - a 

first device 12 associated with an originating user, and a second device 14 associated 
with a recipient user. The first device 12 is coupled to the network through a relatively 
low bandwidth channel, whereas the second device 14 is coupled to the network 
through a relatively high bandwidth channel. (For example, the first device may be an 
15 internet-capable cell phone having low resolution-, still image only- capture 

capabilities, providing a 9600 baud data channel, or it may be a home PC, with an 
associated PC or digital single shot camera, coupled to the internet with a 28.8 kbps 
modem. The second device may be a computer coupled to the internet through a 1 .45 
megabit per second T-l line, a cable modem, etc.) The network 10 connecting the two 
20 devices includes various links - narrow bandwidth at some parts (e.g., 16), very 
broadband at other (e.g., internet backbone 18), etc. 

Assume the user of device 12 encounters a printed image, e.g., an advertisement 
inamagazine, thatmay be of interestto the user of device 12. Using an imaging 
device (e.g., a CMOS- or CCD-camera built into a cell phone, a flatbed scanner 
25 connected to a PC, etc.), device 1 2 captures an image of the advertisement. 

In prior art techniques, the image captured by device 12 would have been sent 
to device 14 over the network; the image received by the second device would be 
exactly the image sent by the first device. 

In accordance with one embodiment of the invention, device 14 receives a 
30 better image than that sent from device 1 2. In one such embodiment, device 1 4 

receives the image data captured by device 12. Device 14 recognizes that the image 
includes a watermark hidden within the image data, and decodes same. The watermark 
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payload includes an index by which a copy of the image can be accessed from a server 
20 on the internet or other storage medium. With this index, the second device 14 
queries the server 20, which returns the ,mage corresponding to this watermark index 
(in this case, the advertisement) back to the second device 14. The image provided by 
the server can be higher resolution or pristine, i.e., it has no artifacts left from scanning 
at device 12, etc. Such a procedure is shown by the flowchart of Fig. 2. 

The watermark payload identifying the sensed image can as long or as short as 
the application requires. Typically, payloads of between 16 and 64 bits are used, 
although this is not essential. Shorter payloads have the advantage that they can be 
more robustly encoded while maintaining a fixed degree of image quality; longer 
payloads offer a greater universe of identifiers with which the image can be labeled. 
Illustrative watermarking technology is detailed in the assignee's patent 5,862,260, and 
in copending application 09/503,881, filed February 14, 2000. A great variety of other 
watermarking arrangements may be used, including those proposed in patents 
5,930,369, 5,933,798, 5,664,018, 5,825,892, 5,940,429 and 5,889,868. 

In accordance with another embodiment of the invention (Fig. 3), the bandwidth 
bottleneck imposed by narrowband channel 1 6 (through which device 12 is coupled) is 
obviated by employing a watermark as a proxy for an image. In such an arrangement, 
the image data captured by device 12 is decoded, and a watermark payload hidden in 
the image is extracted. (This can be performed by hardware or software available in 
devicel2, e.g., a cell phone microprocessor, a desktop computer, dedicated decoder 
circuitry, etc. Alternatively, this decoding can be done remotely from device 12, but 
before device 14, e.g., by a smart router in the intervening network. In the following 
discussion, decoding in the device 12 is assumed.) Instead of transmitting the image 
data over the network, the watermark decoding device (e.g., device 12) simply 
transmits the watermark payload (or a part thereof). On receipt of the payload, device 
14 again queries the server 20, and obtains the image (and/or additional content or 
functionality, as detailed below), corresponding to that watermark. The image is 
obtained over the high-speed channel(s) between the server and the second device; the 
30 low bandwidth channel linking the first device conveys just the low bandwidth 
watermark payload information. 
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By building filters into the low bandwidth devices, upon recognition of a class 
of watermarks indicating availability of the image as a shared resource, or upon user 
selection of "transmit only watermark data", the image [or content associated with it via 
the watermark] can be made available to the message recipient via more capable 
transmission means. 

A variant of the foregoing does not transmit the watermark payload to the 
second device 14. Instead, the payload is dispatched by the first device 12 (or the smart 
router) directly to the server 20, with instructions that the corresponding desired image 
be sent to the second device 14. Such an arrangement is shown in Fig. 4. 

In some applications, the media delivered by the server may be richer than the 
simple image captured by device 12. For example, the watermark payload in the image 
captured by device 12 may index one or more files on server 20 that includes video, 
animation, sound, executable applications, aplets (e.g., JAVA, ActiveX) etc ("enhanced 
content"). Thus, scanning of a magazine ad at one device can prompt delivery of a 
video, a Macromedia ShockWave presentation, etc., to the second device. 

In some embodiments, the second device 14 identifies to the server 20 its 
media-playback capabilities. The server 20 can then respond to a watermark-based 
query with media appropriate to that particular media consumer. 

One way the media capabilities of device 14 can be indicated to server 20 is by 
a data word comprising flag bits, with each set "1" bit indicating a capability. A 
simplified 8-bit capability word may be as follows: 



Bit 


Capability 


0 


GIF file display 


1 


TIFF file display 


2 


JPEG filed display 


3 


AVI movie display 


4 


WAV sound 


5 


RealAudio sound 


6 


MP3 sound 


7 


WindowsMedia 
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The data comprising this word may be automatically compiled on device 14, e.g., from 
the operating system database with which programs are registered on installation (the 
Registry database in Windows). 

If device 14 sends the capability word 10101 100 to server 20, the server knows 
5 the device 14 supports GIF and JPEG imagery (but not TIFF), and RealAudio and 
WAV sound (but not MP3 or WindowsMedia). 

If server 20 has media content corresponding to the queried watermark in 
several supported formats, it can deliver certain ones according to a priority order (e.g., 
send JPEG if supported; else send GIF if supported; else send TIFF if supported). 
) If the server 20 only has media in a format not supported by the second device 

14 (e.g., TIFF in the foregoing example), the server may invoke a conversion routine to 
perform an on-the-fiy conversion to a supported media type (e.g., JPEG) prior to 
sending to the second device 14. 

If the watermark index is provided by the second device 14 (rather than directly 
from the first device 12), the capability data word can accompany the index. 

If the watermark index is provided directly from the first device 12, the server 
can solicit from the second device 14 a data capability word before responding to the 
query. Alternatively, the server can keep, on-flle, a database detailing the media 
capabilities of all known media consumers, and can tailor its query response according 
to such profile. (The second device 14 can be arranged to automatically inform server 
20 of updates to its capability, e.g., each time a new media playback application is 
registered in the registry database.) 

If the server 20 does not know, and cannot discern, the media capabilities of the 
second device 14, it can provide media in a default form that is most likely to be 
acceptable (e.g., JPEG, if the content captured by the first device 12 is imagery). 

Fig. 5 shows a photocopier 50 according to another aspect of the invention. The 
photocopier includes a platen 52, a scanner assembly 54, a raw data memory 56, a 
watermark decoder 58, a processor 60, a network connection 62, a pristine image buffer 
64, a compositing memory 66, and a reproduction engine 68. 

A paper document, such as document 70, is placed on platen 52, and scanner 
assembly 54 is activated to generate scan data corresponding to the document. The 
scanner assembly is conventional and may include a linear array of CCD or CMOS 
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sensor elements that optically scans along an axis of the platen to generate 2D image 
data. Alternatively, the scanner can comprise a 2D array of sensor elements onto which 
an image of the document is projected through one or more lenses. In the illustrated 
embodiment, the document 70 includes a picture 71 that is encoded with a plural-bit 
5 digital watermark. Document 70 may be referred to as a compound document since it 
incorporates plural components (e.g., text and picture). 

The scan data from the scanner assembly 54 is stored in the raw data memory 
56, where it is analyzed for the presence of watermark data by the watermark decoder 
58. 

1 o There are many different techniques by which imagery can be digitally 

watermarked and decoded. One is the noted Digimarc watermark system detailed, e.g., 
in patent 5,862,260, and in pending application 09/452,023, filed November 30, 1999, 
the disclosures of which are incorporated herein by reference. A great variety of other 
systems are known. All that is required is that the watermark permit the conveyance of 
15 plural-bit auxiliary data without objectionable image degradation. 

Upon detection of the watermark in picture 71, the processor 60 is programmed 
to initiate communication with a remote server 72 (e.g., over the internet) through the 
network connection 62. The programmed processor sends to the server a query 
message identifying the detected watermark (which may be, e.g., an identifier of 16 - 
20 64 bits). A database 74 at the server 72 searches its records 77 for a digital object 

indexed by that watermark ID 79 and, if located, causes a pristine version of the object 
78 (in this case a pristine version of the picture 71) to be sent to the photocopier. 

In the embodiment illustrated, the database has the pristine version of the object 
stored within the database record for that watermark ID, and relays same directly back 
25 to the photocopier. In other embodiments, the object itself is not stored in the database. 
Instead, the database stores (in a record associated with the watermark ID) the address 
of a remote data repository at which the pristine object is stored. In this case the object 
server 72 can transmit an instruction to the remote repository (e.g., again over the 
internet), requesting the remote repository to provide the pristine object. The object 
30 can be sent directly from the remote data repository to the photocopier, or may be 

relayed through the object server 72. In any case, the pristine object may be provided in 
TIFF, JPEG, GIF, or other format. (In some embodiment, the request signal from the 
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photocopier specifies the format desired, or may specify plural formats that the 
photocopier can accept, and the pristine object is then output by the server 72 or remote 
repository in such a format. In other embodiments, the request signal from the 
photocopier does not include any format data.) 
5 In some embodiments, the object server 32 can be of the sort more particularly 

detailed in copending applications 60/164,619 (filed 1 1/10/99), and 09/343,104 (filed 
6/29/99), published in WO 00/70585, the disclosures of which are incorporated herein 
by reference. 

In addition to detecting the ID of any watermark in the scanned image data, the 
10 photocopier's watermark detector also discerns the placement of the watermarked 

picture within the document image, and its state (e.g., size, rotation, etc.), and produces 
corresponding state information. In some embodiments, this state information is passed 
to the object server 72, permitting the pristine object 78 to be sized/rotated/etc. (e.g., by 
the object server) to match the object detected in the document image. In other 
1 5 embodiments, a generic version of the pristine object is passed back to the photocopier, 
and the processor 60 attends to sizing, rotating, etc., of the pristine picture 78 as 
necessary to match that of the original picture 71 . 

In some embodiments the picture 71 in the paper document has been cropped. 
(The watermark can nonetheless be detected from the cropped image.) When the 
pristine picture 78 is received from the remote location, it can be pattern-matched to the 
picture 71 detected in the original document to determine the cropping boundaries (if 
any), and corresponding cropping of the pristine picture can be effected. 

Once the foregoing scaling/rotation/cropping, etc., adjustments (if any) have 
been made on the pristine picture 78 stored in buffer 64, the processed pristine picture 
is combined with the original document scan data in compositing memory 66, yielding 
a composite document image that includes the pristine picture data 78 in lieu of the 
scanned picture 71. (The substitution of the pristine picture for the original picture data 
can be accomplished by various known image processing techniques, including 
masking, overwriting, etc.) The composite document image is then passed to the 
reproduction engine 68 to produce a hard-copy output (i.e., an enhanced compound 
document 70') in the conventional manner. (The reprographic engine 68 can take many 
different forms including, e.g., xerography, ink-jet printing, etc.) 
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The pristine picture 78 received from the server 72 can, itself, be watermarked 
or not. If watermarked, the watermark will usually convey the same payload 
information as the watermark in the original picture 71, although this need not always 
be the case. In other embodiments, the pristine picture 78 received from the remote 
5 server 72 has no watermark. In such case the pristine picture can be substituted into the 
compound document 70 in its unwatermarked state. Alternatively, the apparatus 50 can 
embed a watermark into the picture prior to (or as part of) the substitution operation. 

If the substituted picture is watermarked, this permits later watermark-based 
enhancement or updating. For example, if the enhanced compound document 70' 
10 including the pristine picture 78 is printed by the photocopier, and the resulting 
photocopy is thereafter photocopied, the latter photocopying operation can again 
substitute pristine picture data for the scanned picture data produced by the second 
photocopier's scanner. Moreover, in applications where it is appropriate for a picture 
to be updated with the latest version whenever printed, the watermarking of the picture 
1 5 78 permits substitution of a latest version whenever the document is scanned for 
printing. 

In other situations, it is desirable for the picture 78 included in the enhanced 
compound document 70' to be unwatermarked. This is the case, for example, in certain 
archival applications where it is important that the document 70' not be changed after 
archiving. By assuring that the picture 78 is not watermarked, inadvertent changing of 
the picture in subsequent photocopying can be avoided. (In cases where the pristine 
image 78 is provided from server 72 in a watermarked state, the photocopier may 
remove or disable the watermark in response to corresponding instructions from a user 
through a user interface or the like.) 
25 From the foregoing description, it will be apparent that embodiments of the 

present invention provide various advantages over the prior art. One is the dispatch of 
high bandwidth enhanced content using a low bandwidth channel. Another is the 
receipt of higher-quality data than that originally captured. Another is delivering 
applications via low bandwidth channels to recipients by capturing images or 
30 watermark data from media content that serve as proxies for the applications. Another 
is the production of "photocopies" that are better than the "originals." 
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Having described and illustrated the principles of our invention with reference 
to specific embodiments, it will be recognized that the principles thereof can be 
implemented in other, different, forms. 

For example, while the invention has been described primarily with reference to 
5 images, the same principles are equally applicable to video and audio. 

Similarly, while the foregoing description has made reference to transmitting 
the watermark, in many implementations only a part of the watermark need be 
transmitted. (The watermark may include error correcting information, or other data, 
not necessary to identify the corresponding data on the server 20.) 

Still further, while the detailed embodiment contemplated a still or video 
camera system for first device 12, much of the functionality of such an image capture 
system isn't essential to the present invention. Instead, an input device that serves a 
simpler "watermark capture" function may be used instead. Such a device can omit, 
e.g., hardware or software components associated with pixel interpolation (commonly 
used to achieve a desired virtual resolution), formatting (e.g., to provide output in JPEG 
form), etc. Such components serve useful functions when the resulting imagery is to be 
displayed or printed, but are superfluous - or detrimental - when the image data is 
simply to be decoded to extract watermark data. 

While the invention is illustrated with reference to steganographic watermark 
technology for identifying the initial content (i.e., that sensed by device 12), other 
technologies can alternatively be used. These include data glyphs, 1- and 2-D 
barcodes, magnetic ink, RF ID tags, UVorlR markings, etc. 

While the detailed embodiment contemplated a single server 20 to serve as the 
repository of content corresponding to watermarks, in other embodiments such a server 
is implemented in distributed fashion. In some embodiments, one server may act as a 
default repository, and can dispatch queries to other servers if the first server cannot 
provide the requested data. Caching of frequently-requested content can be provided at 
various locations through the network. Additional details on such network 
configurations can be found in application 09/343,104 (WO 00/70585). 

In the photocopier embodiment, it will be recognized that the same principles 
are equally applicable in other systems, including personal computers (e.g., in 
conjunction with image editing software, such as Adobe Photoshop). In such case the 
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input image data needn't come from a scanner but may come, e.g., from a digital file, 
from a network location, etc. The reference to "documents" in this embodiment is 
illustrative only; the technology can similarly be employed with any compound object 
that includes a watermarked component - whether in digital or analog form. Moreover, 
while the Fig. 5 embodiment is described as using separate raw data memory 16, 
pristine image buffer 24, and compositing memory 26, more typically some or ail of 
these functions are served by a single memory, which may be a computer system's 
main RAM memory. 

While the Fig. 5 embodiment employs a processor 60 programmed in 
accordance with software instructions (e.g., stored in a memory or on a storage 
medium), in other embodiments some or all of the described functionality can be 
achieved using dedicated hardware (e.g., ASICs), or programmable hardware (e.g., 
PLAs). 

Although the Fig. 5 embodiment is illustrated with reference to an arrangement 
in which a document includes a single watermarked photograph, it will be recognized 
that plural such watermarked components may be present in a compound document, 
and the system may be arranged to obtain pristine versions of each, and edit/composite 
same as necessary as to recreate an enhanced version of the original document. 
Likewise, while the illustrative embodiment contemplates that a watermarked 
photograph may be a component of the original document, in other embodiments the 
watermarked object may comprise the entirety of the original document. 

While reference has been made to substitution of pristine image components, in 
some embodiments it may be desirable to substitute components that are not "pristine." 
Indeed, in some embodiments an object may be substituted that is visually dissimilar to 
the original object. Consider artwork for a Christmas card. The artwork may include a 
watermarked "generic" corporate logo. When encountered by a computer according to 
this aspect of the present invention, the generic logo may be replaced with a logo 
corresponding to the corporate owner of the computer. In such case, the substitute 
imagery may be stored within the computer itself, obviating the need for any network 
connection. The registry database maintained by the computer's operating system may 
include keys defined by watermark IDs. When a watermark ID is encountered, the 
registry database can be consulted to identify a corresponding graphic that can be 
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substituted into the obj ect being processed. If none is found, the watermark ID can be 
passed to the remote server 72. 

While, for expository convenience, the Fig. 5 embodiment was described as 
always substituting pnstine data when available, more typically this is a function that 
5 would be enabled or disabled by an operator of the device, e.g., by an appropriate 
switch, button, or user interface control. In some embodiments, the device may be 
arranged to query the user when substitution of a pristine component is possible, in 
some cases presenting the user with a depiction of the image component proposed to be 
substituted. 

The Fig. 5 embodiment may be said to employ watermark-based object 
embedding, since the hard-copy output is static (i.e., cannot change) after printing In 
other embodunents, the enhanced compound document 70' is not printed, but stored 
Each time the compound document is utilized (e.g., opened for editing, or printed), any 
watermarked component(s) therein can be updated to include the latest-available 
versions) of the watermarked component(s). In such case, the document may be said to 
employ watermark-based object linking. 

As is familiar to those skilled in the arts, all of the foregoing methods may be 
performed using dedicated hardware components/systems for the various devices, 
and/or through use of processors programmed in accordance with firmware or software, 
etc. In the latter case the processors may each include a CPU and associated memory, ' 
together with appropriate input and output devices/facilities. The software can be 
resident on a physical storage media such as disks, and can be loaded into the 
processors' memory for execution. The software includes instructions causing the CPU 
to perform the various processes detailed above. 

To provide a comprehensive disclosure without unduly lengthening this 
specification, applicants incorporate by reference the patents and applications cited 
above. 

In view of the wide variety of embodiments to which the principles of our 
invention can be applied, it should be recognized that the detailed embodiments are 
illustrative only and should not be taken as limiting the scope of the invention. Rather 
we chum as our invention all such embodiments as may come within the scope and 
spirit of the following claims, and equivalents thereto. 
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WE CLAIM: 

1 . A method comprising: 

sensing a media object in human-perceptible form, and converting same to an 
electronic form, said sensing and converting being performed by a first device; 
decoding object identification data from the electronic form; 
by reference to said object identification data, identifying a set of data stored in 
a repository at a remote site, the set of data comprising at least one media content file; 
and 

sending said set of data from said repository. 

2. The method of claim 1 in which the object identification data comprises 
plural-bit watermark data steganographically encoded within the sensed media object. 

3. The method of claim 2 in which the media content file represents the same 
15 media object as originally sensed, but represented with higher fidelity or accuracy. 

4. The method of claim 2 in which: 

the media object comprises a graphic on a printed page; and 
the sending comprises sending the set of data to a second device remote from 
20 the first device. 

5. The method of claim 2 in which the decoding is also performed by said first 
device, and the method includes sending at least a part of the watermark data from the 
first device. 



25 



6. The method of claim 5 which includes sending at least a part of the 
watermark data to a second device, the second device being remote from the first 
device. 

7. The method of claim 6 in which the data repository comprises the second 

device. 
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8. The method of claim 7 that includes sending a destination identifier to the 
data repository from the first device, the data repository thereafter sending the set of 
data in accordance with said destination identifier. 

9. The method of claim 6 in which the second device is distinct from the 
repository, and in which the method includes: 

from the second device, accessing the repository by use of at least of a part of 
the watermark data; and 

receiving at the second device, the set of data from the data repository. 

1 0. The method of claim 9 which includes transmitting capability data from the 
second device to the repository, the capability data indicating the type(s) of media 
acceptable to the second device, and sending from the repository to the second device 
one of said types of media corresponding to said watermark data. 

1 1 . The method of claim 5 in which the sending comprises sending to a second 
device, the second device being remote from the first device and being distinct from the 
repository. 

12. The method of claim 2 in which the decoding is performed by a second 
device remote from the first device. 



13. The method of claim 2 that further comprises: 

sending the electronic form of the media object to a second device remote from 
the first device; 

decoding the watermark data from said electronic form at the second device; 

and 

using at least part of said watermark data to access a data repository at the 
remote site; and 

receiving, at the second device, the set of data from said data repository. 
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14. The method of claim 13 in which the data repository comprises the second 

device. 

1 5. The method of claim 13 in which the data repository is distinct from the 
5 second device. 

1 6. The method of claim 2 which includes decoding the watermark data at a 
device remote from the first device. 

10 17. The method of claim 16 which includes sending the set of data from the 

repository to a second device after decoding the watermark data at a third device 
distinct from the first and second devices. 

18. The method of claim 2 in which the media object comprises audio. 

15 

19. A method of invoking delivery of a set of data from a repository to a 
destination that includes: 

sensing a media object in human-perceptible form, and converting same to 
electronic form, said sensing and converting being performed by a first device; 
20 decoding object identification data from the electronic form; and 

transmitting at least some of said decoded object identification data, without 
transmitting said electronic form, so as to invoke delivery of the set of data from the 
repository to the destination. 

25 20. The method of claim 19 in which the object identification data comprises 

plural-bit watermark data steganographically encoded within the sensed media object. 

21. A computer storage medium having stored thereon instructions causing a 
computer to perform the method of claim 19. 

30 

22. A device comprising an image sensor coupled to a watermark decoder, said 
device having a mode of operation in which it provides output data comprising plural- 



BNSDOCID <WO 0148682A1J_> 



WO 01/48682 



PCT7US00/35038 



- 16- 
bit watermark payload information from image sensor data but not processed image 
output data for external use. 

23. An image capture device having two modes, in the first mode said device 
serving as the device of claim 22, in the second mode said device providing image 
output data for external use. 



24. A system for producing an enhanced digital object comprising: 
a source of original object data; 
a watermark detector; and 
a source of substitute data; 

the aforesaid elements cooperating to permit substitution of a substitute object 
component for an original component found in the original object data by reference to 
watermark data encoded in the original object component. 

25. The system of claim 24 that further comprises a printing engine having an 
input for receiving print data that includes the substitute object component. 

26. A photocopier according to claim 25, wherein the source of original object 
20 data comprises a scanner. 

27. The system of claim 24 in which the source of substitute data is located 
remotely from said system. 

25 28. A method of enhancing an original digital object comprising: 

recognizing a component of the original digital object having a watermark 
encoded therein; 

by reference to said watermark, obtaining a counterpart to said component; and 
substituting the counterpart into the digital object to produce an enhanced 

30 object. 
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29. The method of claim 28 in which the counterpart component has a 
watermark encoded therein. 

30. The method of claim 29 that includes removing or disabling the watermark 
5 from the counterpart component before substituting. 

31. The method of claim 28 in which the counterpart component does not have 
a watermark encoded therein. 

10 32 . The method of claim 3 1 that includes encoding a watermark in the 

counterpart component, so that the counterpart component in the enhanced object 
includes a watermark. 

33. The method of claim 28 in which the obtaining includes transmitting a 
15 request signal to a remote server. 

34. The method of claim 33 that further includes providing the substitute 
component from the remote server. 

20 35. The method of claim 34 that includes directing a request to a repository 

remote from the server, and providing the substitute component from the remote 
repository. 

36. The method of claim 28 that includes sizing, rotating, and/or cropping the 
25 counterpart component prior to substituting. 

37. The method of claim 36 that includes sizing, rotating, and/or cropping the 
counterpart component at a location different than the substituting. 

30 38. The method of claim 28 in which the substitute component is visually 

dissimilar from the component in the original object. 



BNSDOCID <WO 01«682A1_1_> 



WO 01/48682 



PCT/US00/35038 



39. The method of claim 28 in which the substitute component is a graphic. 

40. The method of claim 28 in which the obtaining includes consulting a 
registry database. 

5 

41. The method of claim 28 in which the obtaining includes obtaining from 
storage physically co-located with a processor that performs the method. 

42. The method of claim 28 that includes repeating the method, with the 
0 enhanced object as the original object, to produce a second enhanced object. 

43. A computer storage media having stored thereon instructions causing a 
processor to perform the method of claim 28. 
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